Application of Conic Optimization and Semidefinite Programming in Classification
نویسندگان
چکیده
In this paper, Conic optimization and semidefinite programming (SDP) are utilized and applied in classification problem. Two new classification algorithms are proposed and completely described. The new algorithms are; the Voting Classifier (VC) and the N-ellipsoidal Classifier (NEC). Both are built on solving a Semidefinite Quadratic Linear (SQL) optimization problem of dimension n where n is the number of features describing each pattern in the classification problem. The voting classifier updates usage of ellipsoids in separating N different classes instead of only binary classification by using a voting unit. The N-ellipsoidal classifier makes the separation by means of N separating ellipsoids each contains one of the N learning sets of the classes intended to be separated. Experiments are performed on some data sets from UCI machine learning repository. Results are compared with several wellknown classification algorithms, and the proposed approaches are shown to provide more accurate and less complex classification systems with competitive error rates.
منابع مشابه
Advances in convex optimization: conic programming
During the last two decades, major developments in convex optimization were focusing on conic programming, primarily, on linear, conic quadratic and semidefinite optimization. Conic programming allows to reveal rich structure which usually is possessed by a convex program and to exploit this structure in order to process the program efficiently. In the paper, we overview the major components of...
متن کاملLMI Approximations for Cones of Positive Semidefinite Forms
An interesting recent trend in optimization is the application of semidefinite programming techniques to new classes of optimization problems. In particular, this trend has been successful in showing that under suitable circumstances, polynomial optimization problems can be approximated via a sequence of semidefinite programs. Similar ideas apply to conic optimization over the cone of copositiv...
متن کاملTractable Approximations to Robust Conic Optimization Problems
In earlier proposals, the robust counterpart of conic optimization problems exhibits a lateral increase in complexity, i.e., robust linear programming problems (LPs) become second order cone problems (SOCPs), robust SOCPs become semidefinite programming problems (SDPs), and robust SDPs become NP-hard. We propose a relaxed robust counterpart for general conic optimization problems that (a) prese...
متن کاملConvex Optimization Models: An Overview
1.1. Lagrange Duality . . . . . . . . . . . . . . . . . . p. 2 1.1.1. Separable Problems – Decomposition . . . . . . . p. 7 1.1.2. Partitioning . . . . . . . . . . . . . . . . . . p. 9 1.2. Fenchel Duality and Conic Programming . . . . . . . . p. 10 1.2.1. Linear Conic Problems . . . . . . . . . . . . . p. 15 1.2.2. Second Order Cone Programming . . . . . . . . . p. 17 1.2.3. Semidefinite Progr...
متن کاملA Polynomial-time Affine-scaling Method for Semidefinite and Hyperbolic Programming
We develop a natural variant of Dikin’s affine-scaling method, first for semidefinite programming and then for hyperbolic programming in general. We match the best complexity bounds known for interior-point methods. All previous polynomial-time affine-scaling algorithms have been for conic optimization problems in which the underlying cone is symmetric. Hyperbolicity cones, however, need not be...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2011